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6.2.1 The Union Bound and Extension 

The union bound or Boole’s inequality [13] is applicable when you need to show that the 
probability of union of some events is less than some value. Remember that for any two events 
A and B we have 

P(A U B) = P(A ) + P(B) - P{A n B) 

< P(A ) + P(B). 

Similarly, for three events A, B, and C, we can write 

P(A U5UC) = P((A U B) U C) 

< P(A U B) + P(C ) 

< P(A) + P(B ) + P(C). 


In general, using induction we prove the following 



The union bound is a very simple but useful result. It is used frequently in different 
applications. Here, we look at one application in the area of random graphs. Random graphs 
are widely used when analyzing social networks, wireless networks, and the internet. A simple 
model for random graphs is the Erdos-Renyi model G(n,p) [11,12]. I n this model, we have n 
nodes in the graph. In social networking context, each node might represent a person. Every 
pair of nodes are connected by an edge with probability p. The occurrence of each edge in the 
graph is independent from other edges in the graph. Figure 6.1 shows an example of a 

1 

randomly generated graph using this model. Here, n = 5 and p was chosen to be ^. 
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Fig.6.1 - An example of a randomly generated graph based on the G(n,p) model. 

1 

Here n = 5 and p was chosen to be -. 

The question we are interested in here is the probability that there exists an isolated node in 
the graph [11,12]. An isolated node is a node that is not connected to any other nodes in the 
graph. In a wireless networking context, an isolated node is a node that cannot communicate 
with any other node in the network. 


Example 6.17 

Let B n be the event that a graph randomly generated according to G(n,p) model has at least 
one isolated node. Show that 

P(B n )<n(l-p) n - 1 . 

In (n ) 

And conclude that for any e > 0, ifp = p n = (1 + e )—~— then 

lim P(B n ) = 0. 


• Solution 

o There are n nodes in the network. Let's call them Node 1, Node 2,..., Node n. Let 
A j be the event that the z'th node is isolated. Then we have 


n 



i= 1 


Thus, using the union bound we conclude that 
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P(B„) = />( U A t ) < ZjU). 

1=1 1=1 

By symmetry, for all i,j, we have P(A •) = P(AJ), so 

P(B„) < nP(A , ). 

Thus, we only need to find P(A^). The event A l occurs if Node 1 is not connected 

to any of the other n - 1 nodes. Since the connections are independent, we 
conclude that 


P{A l ) = {\~p) 


n — 1 


Therefore, we obtain 


P(B n ) < n( \ - p ) 


n — 1 


which is the desired result. To prove the limit result, we use 


O'- 

+ ~) x = e c , for any constant c£R. 

x 


X— >0O 


So, we obtain 


lim^^l -p n ) n 1 


In 77 "I 

lhn n^n 



r i +c ~\ , 

lim n 

i — K 1 

n — > go 

— J 


In n 


/r 1 + f "I ” \ 

lim n 1 


n — » go \ 

l " J / 


In n 

lim 

1 


llm 77^O0^ 



= 0 . 


But since P(B n ) > 0, we conclude 


lhn P(B n ) = 0. 

77—>0O 
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It is an interesting exercise to calculate P(B U ) exactly using the inclusion-exclusion principle: 

n 

Z PO,) - 2>Oi n x,) 

i= 1 i<j 

n 

+ 1 P{A i n Aj p A k )~ ... +(- i )”- 1 J p ( n ^ / 

i<j<k \'= 1 

In fact, the union bound states that the probability of union of some events is smaller than the 
first tenn in the inclusion-exclusion formula. We can in fact extend the union bound to obtain 
lower and upper bounds on the probability of union of events. These bounds are known as 
Bonferroni inequalities [13] . The idea is very simple. Start writing the inclusion-exclusion 
formula. If you stop at the first term, you obtain an upper bound on the probability of union. If 
you stop at the second term, you obtain a lower bound. If you stop at the third term, you obtain 
an upper bound, etc. So in general if you write an odd number of terms, you get an upper 
bound and if you write an even number of terms, you get a lower bound. 



Generalization of the Union Bound: Bonferroni Inequalities 
For any events A l5 A 2 ,..., A n , we have 

n n 

p(Ud<Z(J,); 

\=\ ' 1=1 
n n 

ffullw,)- 

\=\ ' i= 1 

n n 


P(A i n Aj); 

i<j 



Example 6.18 
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Let B be the event that a graph randomly generated according to G(n,p ) model has at least 
one isolated node. Show that 

P(B n )>n(l-p) n - 1 - Q(1-p) 2 " -3 . 

• Solution 

o Similar to Example 6.17, let Aj be the event that the /th node is isolated. Then we 
have 

n 

B„= U A, 

i= 1 

Thus, using two terms in the inclusion-exclusion principle, we obtain 

n n 

P(B n ) = /tU A,) > Y p ( A i) - 2>^/ n A j}- 

/= 1 /= 1 i<j 

By symmetry, we obtain 

n 

X P ( A i) = nP(A i), 

i= 1 

5>^-n^) = ("k, nj 2 ). 

i<J V 7 

Thus, we conclude 

P{B n )>nP{A x )-^ 2 y{A^A 2 ). 

In Example 6.17 we found 

P(A l ) = {\-p) n -\ 

Similarly, we obtain 

P(A , n^ 2 ) = (1 - / ,) 2 («-2) + l = (i - p ) 2n ~ 3 . 

The reason for this is that A 1 D A 0 is the event that Nodes 1 and 2 are isolated. 
There are 2 (n - 2) potential edges from the rest of the graph two Nodes 1 and 2, 
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and there also is a potential edge from Node 1 to Node 2. These edges exist 
independently from each other and with probability p n . We conclude 

P(B n )>n(l-p) n - l -Q(l-p) 2n - 3 , 
which is the desired result. 


Expected Value of the Number of Events: It is interesting to note that the union bound formula 
is also equal to the expected value of the number of occurred events. To see this, let 
ApA 2 ,..., A n be any events. Define the indicator random variables X l ,X 2 ,...JC n as 

,1 if ^4 7 occurs 

v 0 otherwise 

If we define X = X^ + X 2 + X 3 + .. . +X n , then X shows the number of events that actually 
occur. We then have 

EX = EX j + EXj + EX^ + . .. + EX n (by linearity of expectation) 

= P(A{) + P(A 2 ) + ... +P(A n ), 


which is indeed the righthand-side of the union bound. For example, from this we can 
conclude that the expected number of isolated nodes in a graph randomly generated according 
to G(n,p) is equal to 

EX=n{ 1 ~p) n ~ l . 
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